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1. INTRODUCTION 

Industries such as textile, semiconductor, food and beverages have agreed that a system based 
approach is more efficient and sustainable to be applied in manufacturing process [1]. Visual inspection is 
categorized into two, which are manual inspection and automatic inspection. Manual inspection is commonly 
used human as inspector for product quality [2]. The study made by [3] have shown the manual inspection 
performed by human operator is inefficient and consume more time due to working condition. The task given 
by industry is repetitive and difficult to do if no proper training is conducted. An automatic inspection seems 
to be better compared to manual inspection. For these reason, the application of an automated inspection 
system for detection and classification of defect is desirable [4]. The application of an automated inspection 
has reduced execution time, computational cost and high percentage error free [5]. 

Some reviews are made from previous research to compare the inspection system technique. 
Researcher in [6] proposed shape detection using a partial erosion-based technique to automate the shape 
segmentation process of plastic bottle. The proposed technique involved morphological and erosion process 
to segment the bottle shape and extract the features from the segmented image. The accuracy of the proposed 
technique is more than 80%. However, the partial erosion-based technique is inefficient and give bad effect 
to the image when the partial erosion is set less than 50% or more than 100%. The statistical histogram based 
Fuzzy C-means (SHFCM) is suggested by [3] to identify the apple defect for fruit quality inspection. 
SHFCM is used to classify the healthy and defect apple. The experimental result shows the accuracy 
achieved by healthy apple is 96% and defect apple is 91%. Nevertheless, SHFCM is the combination of the 
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statistical histogram and fuzzy c-means which makes the algorithm more complex and prone to misclassified 
healthy and defect apple. 

For level detection, liquid level inspection system has been developed by [7] based on infinite 
symmetrical edge filter (ISEF) detection technique to replace traditional quality inspection perform by a 
human operator. The process includes image cropping and normalizing, filtering and detecting. The analysis 
results show the proposed technique is better detection of overfill and underfill for liquid level. The proposed 
technique is not suitable for the quality image because it will over segment the image. Furthermore, [8] 
proposed feature extraction and edge detection algorithm to inspect fill level and cap in bottling machine. 
Classification of liquid level and cap closure is done by using neural network (NN) technique. The proposed 
technique proves that it can inspect liquid level and cap of bottle accurately. Nevertheless, lower or empty 
liquid level cannot be detected and too many pre-processing techniques will reduce the image quality. 

Based on literature, two main problems that occur during beverage bottle quality inspection are 
highlighted. First, the used of manual inspection is highly prone to human error. Second isan inappropriate 
image processing technique chosen is highly prone to under or over segmentation, on the other hand lead to 
loss of precision. Hence, this paper proposed a new analysis technique of shape and level for beverages 
quality inspection system using local standard deviation and Hough transform. The contrast enhancement 
technique provide by LSD will give different contrast level in order to prevent from under and over 
segmentation of the image. Thus, the shape of the image can be segmented accurately compared to previous 
technique,andpractically appropriated for industrial real-time inspection system [9]. Meanwhile, Hough 
transform is proposed because of its robustness to noise and capability to detect line without enough 
information, in accordance achieved betteraccuracy in detecting multiple object compared to others previous 
technique [10]. 


2. RESEARCH METHOD 

The analysis of shape and level defect detection is done using the MATLAB software. The 
framework analysis of shape and level detection is shown in Figure 1. A 100 sample images is used for shape 
defect detection and 55 sample images for level defect detection. The sample image is captured using Canon 
D3100 digital camera with 12 megapixels. Then, the captured image is pre-processed to eliminate the noise 
and enhance the brightness of the image for further analysis. 
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Figure 1. Framework analysis 
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2.1. Pre-Processing 

Pre-processing is a common operation to standardized the image in order to minimize the 
complexity of the algorithm [11]. The noise occur on the image may give complexity during segmentation 
process. Besides, the background image is given similar gray level values with certain bottle structures. 
Therefore, pre-processing is carried out to correct the image for furtheranalysis. 
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2.2. Segmentation using Local Standard Deviation 

The Local Standard Deviation (LSD) is part of the Adaptive Contrast Enhancement (ACE) function 
to segment the shape of the image. ACE is known as an unsharp masking technique where the function is 
applied at the unsharp mask to amplify the image which haslow-frequency components. Besides, ACE will 
adjust the contrast gain of the image into suitable value. The general equation [12] is defined as 


fi, j) =m, (i, j+ GG, )[xG j) -m,(i, j)] (1) 


where 77, = (i, j) is the local mean, G = (i, j) is the contrast gain and x = (i, j)is gray scale value at 


any point of the image pixel. 

In the ACE, the function of LSD is to enhance the contrast gain of the image from low to high and 
high to low [13]. The ringing and noise result may occur if the contrast gain is set manually. ACE function is 
inversely proportional to LSD make the background image can be identified and eliminated at the edge of 
bottle. The unwanted contrast gain in the image is eliminated by enhancing the contrast gain from low to high 
using LSD function [14]. The function of LSD is expressed as 


D 
a(i, j) 


fG j) =m, (i, jt [xG j)-m,(i, J] (2) 


where D is a constant value for contrast and oy Ci, j) is a function of LSD. From equation (1), the 
contrast gain is automatically controlled by the o, (i, j). Therefore, for the region that has small 


m, = (i, j) leads to an unexpectedly high value of LSD and vice versa. 


2.3. Hough Transform 

Hough transform is applied for the binary image to detect the lines of the water level in the bottle. 
The white pixels in the image has created a locus of reference points that accumulated in accumulator array 
of Hough space. The voting process is involved for line detection where every pixel in the image votes for all 
possible line corresponding to reference point. A line is passing through several feature points and maximum 
point which have indicated as reference points in the Hough space. Generally, (x,y) space is converted into 
(p,8) space which can be expressed as 


p=xcosé+ ysind (3) 
where p is the length of the line from the origin. 0 is the angle of the p with respect to the x direction. Figure 


2 shows the conversion of xy space into (p,@) space where the lines are created based on several points in 
order to find the maximum and minimum value. 


Xmin 


Xmax 


Figure 2. Created lines using Hough transform 
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2.4. Feature Extraction 

In image analysis, feature extraction is required to be input for classification process. A set of 
features are extracted from the segmented images based on the shape and level. For the shape features, 
parameters such as height, width, area and extent are extracted. Meanwhile, the water level feature is 
extracted by finding the maximum and minimum value of water level. These features are important to 
classify the defect of the image. 


2.4.1. Shape Detection 

Four parameters are extracted in shape features, which are height, width, area and extent. Figure 3 
shows the dimension of the bounding box in the binary image that is used to obtain the area of the bottle. 
Based on Figure 3, the height of the image is determined as 4160 pixels while the width is obtained as 3120 
pixels. The area of the bottle is calculated based on the white pixel. In determining the extent value, the area 
of the object is divided with the area of the bounding box in order to classify the shape defect of the bottle. 
The extent value is calculated as follows 


Bias Area of object 


Area of bounding box 4) 


The white pixel has represented the shape of the bottle while the black pixel is the background 
image as illustrated in Figure 3. Hence, the area of the object is determined by the value of the white pixel. In 
addition, the area of the bounding box is obtained from multiplication value of height and width that can be 
expressed as 


Area of bounding box = height x width (5) 


0 3120 


4160 


Figure 3. Bounding box dimension 


2.4.2. Level Detection 

The water level feature has been extracted using Hough transform that created the tangent line for 
the measurement distance between the maximum and minimum values. Figure 4 shows the maximum and 
minimum line of the water level. Each level of water has been labeled that is illustrated in Figure 4. 


Figure 4. Label for level of water 


Shape and Level Bottles Detection using Local Standard Deviation and Hough ... (Norhashimah M.S.) 


5036 O ISSN:2088-8708 


The level of water is classified in three conditions, whichare good, overfilled and underfilled. From 
Figure 4, the level of water, y is calculated from the distance between maximum (Xmax) and minimum (Xmin) 
as formulated in equation (6). The Zmay and Zmin Value are set based on the good condition value of the 
bottle. The condition is good when the level is between the Zmay and Zmin, If the level is above than Zmax» it 
will consider as overfilled. Otherwise, if the level is below than Zmin, the condition is underfilled. 


y = X max ~ X min (6) 


2.5. Decision Tree Classifier 

In order to classify the defect of shape and level, decision tree is implemented in this study. The tree 
consists of branches, nodes and leaves that are used for the classification process. Branches of the tree are 
indicated as values while nodes are represented as the name of data. The labels of the classare shown by the 
leaf [15]. Figure Sillustrates the training set of decision tree process that includes shape and level 
classification. Based on Figure 5, the decision tree model learns the extracted features of the bottle, which are 
extent valueand level. If the feature is the extent value, the shape of the bottle will be classified either good or 
defect condition. When the feature is the level value, the water level is classified into three conditions such as 
good, overfilled and underfilled. 


Feature Extraction 
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Figure 5. Decision tree process 


3. RESULTS AND ANALYSIS 
Figure 6 shows four different colors of bottles with the same size and level are used in this analysis 
as reference image. 


® a Qa had 
Figure 6. Reference image 


Local standard deviation (LSD) uses contrast enhancement technique to segment the shape of the 
bottle. The segmentation of the bottle is applied to classify the shape condition either good or defect. Figure 
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7(a) to Figure 7(d) shows the shape analysis process for the defect bottle. The process is started with the 
conversion of red, green and blue (RGB) color image in Figure 7(a) into a grayscale image in Figure 7(b). 
The conversion process is applied to reduce the complexity from 3-dimensional pixel into 2-dimensional 
pixel. The grayscale image is then transformed into standard deviation image as shown in Figure 7(c). In this 
process, standard deviation algorithm is applied to segment the shape of the bottle by separating the bottle 
and the background image. 

The background noise at the edge of the bottle can be removed by increasing the value of LSD 
resulting the reduction of contrast gain of the image. Therefore, the shape of the bottle is outlined using the 
white line to separate between the shape of the bottle and the background image. The standard deviation 
image is converted into a binary image as represented in Figure 7(d), in which the shape of the bottle is 
presented in white pixel (1) while the background image in the black pixel (0). 

Finally, the parameters extracted from Figure 7(d) are used as an input for the classification process. 
Four parameters namely height, width, area, and extent are extracted from the good and defect shape images. 
The extent parameter is calculated based on the ratio of the bottle area and the bounding box area that stated 
in the equation (4). For the area of bounding box, equation (5) is used by multiplying the height and width 
value. As expected, both sample images have similar area of bounding box but different value of the bottle 
area. The area value for good bottle was higher compared to defect bottle which then influenced the extent 
value. 


Defect Defect 


e a | | 
a » » 
| | 
(a) (b) (c) (3) 


Figure 7. Shape detection process: (a) Input stage, (b) pre-processing stage, (c) LSDstage, (d) feature 
extraction stage 


The implementation of Hough transform makes the maximum and minimum of water level is 
estimated using voting process. The level defect detection process is indicated in Figure 8(a) to Figure 8(d). 
The sample of reference image in Figure 8(a) is converted into gray scale image. Then, LSD technique is 
applied to segment the level of the water that is shown in Figure 8(b). Figure 8(c) illustrates the several lines 
created using Hough transform technique to find the maximum and minimum level value based on the white 
pixel of the image. The line detection image is shown in Figure 8(d), in which the blue line presents 
minimum level and the red line indicates maximum level. The process is repeated for overfilled and 
underfilled condition as graphically shows in Figure 9(a) and Figure 9(b). 


a 
A a DE B- 
(a) (b) (c) (d) 


Figure 8. Good level image: (a) Sample image, (b) segmented image, (c) Hough transform image, (d) line 
detection image 
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(a) (b) 


Figure 9. Level image: (a) Underfilled, (b) overfilled 


In obtaining the threshold value of the water level, the distance of the water level is calculated 
between the maximum and minimum lines using the equation (6). Figure 10 shows three misclassified of x 
node (red color) that plotted in scatter diagram. In defect condition, there is case where decision tree 
misclassified the shape of the bottle as good condition. This case will lead to inaccuracy that inappropriate 
for real time application. Figure 11 illustrates the scatter plot diagrams that classify the sample image based 
on level condition, which are good, overfilled and underfilled. Based on Figure 11, the decision tree is 
misclassified ofx node (blue color) as good condition. The actual class of the misclassified node is 
underfilled and overfilled condition. 
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Figure 11. Scatter plot diagram of level defect classification using Hough transform 


The comparison in term of accuracy for shape and level detection techniques are shown in Figure 
12. From the findings, LSD technique shows the highest percentage with accuracy 97% followed by SHFCM 
with 91% and morphological operation with 80%. In this case, the outcome using morphological operation is 
error prone, not to mention a large different of 17% compared to LSD. The aim for level detection is 
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findingan appropriate analysis which can detect level of liquid bottle accurately.Hence, Hough transform has 
proven that it can perform absolutely well in detecting liquid level by achieving 93% accuracy using decision 
tree classifier. 
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Figure 12. Performance analysis for shape and level defect detection 


4. CONCLUSION 

In this paper, the analysis of shape and level of bottle is presented using local standard deviation and 
Hough transform. The analysis involved pre-processing, segmentation, feature extraction and classification. 
The sample image is pre-processed to eliminate the noise that occurs on the image which gives complexity 
during segmentation process. In segmenting the image, LSD technique is applied byenhancing the contrast 
gain of the image from low to high. For shape features, extent parameter is calculated to determine the ratio 
of the bottle area. Meanwhile, Hough transform is used to extract the features of the water level such as 
maximum and minimum level. The decision tree classifier is applied to classify the shape and level either 
good or defect. The performance of the proposed techniques is verified in terms of accuracy. The 
experimental result shows 97% and 93% accuracy is achieved by shape and level detection. Thus, the 
proposed techniques demonstrate the potential to detect the shape and level for beverages product. 
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